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Abstract 

The present study contrasts participants' evaluations of their self help 
meetings with independent observers 1 evaluations and describes the 
components of their respective views in temis of the actual behaviors 
occurring during the meetings. Data were collected from 334 GROW meetings 
in Illinois using the SHIC, an observational coding system designed for the 
self help context, and two rating measures. Principal components analyses 
for participants 1 and observers' rating measures yielded a single evaluation 
variable for participants, and two evaluation variables for observers. 
Multiple regression analyses were performed using the three evaluation 
variables as criterion variables and the SHIC behavioral occurrence 
variables as predictors. Results indicated that participants' positive 
evaluations of a self-help meeting were predicted by the relative absence of 
negative behaviors and the presence of supports, interpretations, and 
guidances. Observers' evaluations were divided Tnto two components, meeting 
quality and positive meeting climate. Meeting quality was predicted by the 
relative absence of group process comments and the presence of the agree and 
personal disclosure codes. Meetings in which there were low proportions of 
negative behaviors and personal questions and high proportions of supports 
and interpretations were likely to be rated by the observer as having a 
positive meeting climate. Similarities and differences between the 
observers' and participants' views are examined. Overall, the behavioral 
occurrence variables were moderately predictive of meeting evaluations; 
reasons for this are discussed and a direction for future research is 
suggested* 
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Measures of Self-Help Group Quality: 
Observer and Participant Views 
Self-help groups are growing in popularity as alternatives and adjuncts 
to traditional mental health services. Nationwide, self-help organizations 
have mushroomed, offering help and support for a variety of problems from 
overeating to widowhood to chronic mental illness. Whatever the targeted 
problem, the weekly group meeting is a hallmark of many self-help group 
approaches. However, the commitment to anonymity and nonprofessional 
helping networks that characterize self-help groups makes empirical research 
on their activities difficult to undertake. Our understanding of self-help 
groups is thus limited, despite the large helping role such groups are 
beginning to take in our society. 

We know very little about the actual behaviors and processes that 
characterize self-help group meetings and still le:s abojt the value of 
these activities to the participants. Short of having data on the objective 
effectiveness of self-help groups, it is instructive to understand the 
participant's view of the value of the weekly meetings. What group 
behaviors lead members to feel positive about their group meetings? In an 
attempt to address this issue, the present study measured actual behaviors 
occurring during self-help meetings and used these behaviors to predict both 
participants' and observers' evaluations of the meetings. 

Data were collected for this study in conjunction with a large-scale 
longitu-Jinal research project evaluating GROW, a self-help organization for 
individuals with a history of emotional or psychiatric problems (see 
Rappaport, et al., 1985 for a detailed description). Founded in Australia 
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in 1957, GROW has expanded to include over 500 groups in Australia, New 
Zealand, Europe and the United States. GROW offers a program for recovery 
and growth to its membership which includes weekly meetings, reading and 
memorizing of GROW literature, and friendly social contact between members. 
GR OW Meetings 

A participant "leader," chosen at each GROW meeting, leads the group 
through the steps of the "group method." Meetings are thus highly 
structured and there is little variation in the essential components of the 
meeting. The meetings open and close with group recitations of prayers and 
pledges, and a period of objective discussion and learning of GROW 
literature is sandwiched between two periods of group problem-solving. The 
GROW training manual (1981) outlines the five primary ingredients of a good 
meeting: 

1. An encounter of persons through personal testimonies i.e., 
descriptions of a member's decline to maladjustment and growth to 
maturity. 

2. Friendly support and help through current problem solving. 

3. Adult education through reading ana discussion of the GROW program. 

4. Mutual activation through the recommendation of practical tasks to 
be carried out in day-to-day living between meet>.gs. 

5. Personal development through reports on and assessment of member's 
progress. 

The Assessment of Group Behavior 

A variety of measures for group activities and processes in the 
self-help context have been developed (e.g., Lieberman, 1979; Levy, 1979). 
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These measures, however, rely exclusively on the retrospective ratings of 
observers and/or group members. No direct assessment of actual in-group 
behavior as it occurs had been attempted in self-help meetings. The 
collaborative nature of the GROW evaluation project (Toro and Keogh, 1984) 
allowed us to circumvent certain constraints that have plagued previous 
self-help researchers. The GROW organization allowed our observers to 
record group behavior as it occurred in the group mpetings. 

Although the direct assessment of group behavior is commonplace in 
other substantive areas of psychology, such as small group and group therapy 
rese.-ch, none of the coding schemes for group behavior from other areas are 
fully appropriate for the self-help context. Drawing on three existing 
systems, Bale's (1950) IPA, Hill's (1969) system for counselor behavior, and 
Whalen's (1969) system for classifying behavior in small groups, we 
developed the Self-Help Interaction Codes (SMC; for details on measure 
development, see Peters, McFadden and Chertok, 1984). The SMC records 
behaviors relevant to the tasks of a self-help group while operating within 
the constraints placed on an observer at an actual, ongoing self-help 
meeting (e.g., no mechanical recording devices). A continuous, 
comment-by-comment coding strategy was employed to preserve the sequential 
structure of the interaction and allow for the examination of patterns and 
sequences of behavior in addition to rates or frequencies of behavior. 
Twelve mutually exclusive and collectively exhaustive coding categories form 
the core of the SMC system (see Table 1 for descriptions of the 12 
cateories). 
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Evaluations of the Meeting 

Although GROW meetings are relatively invariant in structure, there is 
a great deal of diversity in the content and quality of the meetings. The 
Participant Kating Form (PRF) was designed to capture the group members' 
perspective on the general quality of the meeting ano their personal 
reactions to the meeting. The ^server Rating Form (ORF) was filled out 
after the meeting by the observer who collected the SMC data and includes 
qualitative and quantitative information on the topics discussed during the 
meeting and ratings of characteristics of both the group members and the 
meeting itself. Witn the exception of global assessments of the quality or 
"goodness" of the meeting, the observers and participants were necessarily 
asked to respond to different items. The participant was able to assess the 
personal impact of the meeting, while the observer responded from a more 
"objective," albeit distant vantage. Given these divergent perspectives and 
the inherent dissimilarity of the items on the two inventories, only a 
moderate level of association between the participant's and the observer's 
evaluations was expected. 

In making their evaluations it was expected that both participants and 
observers would consider the GROW organization's espoused goals and ideals. 
Fundamentally, the weekly GROW meetings are opportunities for "caring and 
sharing." To the extent that participants and observes relied on this 
basic conceptualization in making their evaluations, it was predicted that 
high proportions of supports and personal disclosures within a meeting would 
be related to a positive evaluation. 
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Method 

Data for the present study were collected from 334 meetings of 13 
different ongoing GROW groups in Central Illinois. For this study, each of 
the 334 meetings represents one "subject." Groups were attended either 
weekly by two alternating participant-observers or LiweeKly by a single 
participant-observer. Meetings generally lasted from 1 1/2 to 2 hours and 
had 3 to 15 people in attendance. 
Participant Rating Form 

The PRF is a 12-item inventory which two group members filled out after 
each meeting. The PRF was given to participants in a systematic fashion so 
that all pcrticipants were asked to complete the inventories an 
approximately equal number of times. However, because of differences in 
members' attendance patterns and the size of a group, the actual number of 
PRF's completed by a participant ranged from 1 to 16. PRF's were completed 
by 232 different individuals in the 334 meetings. 

Two items were differenced to create a variable that reflected the 
change in a participant's feeling state (relaxed vs. upset) bef . re and after 
the meeting. Ten PRF items and this difference score were analyzeu using 
a principal components procedure with varimax (orthogonal) rotation of 
components having eigenvalues of 1.0 or more. Two principal component 
analyses were done, one using the first rater at each meeting and the second 
using the second rater at each meeting. A two component solution was 
obtained in each case. Only one of the two components represented an 
evaluation of the meeting, the second was interpreted as a "good-GROW- 
member" component, and reflected the behavior of the participant rather than 
* 8 
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characteristics of the group meeting. For the purposes of this study, only 
the meeting evaluation component was used. The congruency coefficient 
(Derogatis, Serio, & Cleary, 1972) of the meeting evaluation components in 
the two analyses was .96, indicating that a relatively stable solution had 
been generated. Items with loadings greater than .50 on the Meeting Quality 
component are reported in Table 2. These items were combined (..ith unit 
weighting) to create a dependent variable reflecting the participants' 
evaluation of the quality of their GROW meetings. 
Observer Rating Form 

Although the ORF is comprised of a variety of ratings of the activities 
and content of a GROW meeting, only the global ratings of the quality and 
atmosphere of the group were selected for analysis here. Two of the 13 
items selected were omitted from all analyses because of insufficient 
variability. The remaining 11 items were analyzed using the principal 
components procedure with varimax rotation of factors having eigenvalues of 
1.0 or more. The resulting two-component solution accounted for 57% of the 
total variance. In order to check the stability of the component solution, 
two additional analyses were done using the same procedures on "split- 
halves" of the total data set. Good correspondence was found between the 
two split-half solutions ^congruency coeffient for the first factor = .99; 
for the second = .95). Both components may be interpreted as relevant to an 
evaluation of the quality of the meeting. The first component appears to be 
most similar to the participants' evaluation factor and was labelled Meeting 
Quality The second factor was labelled Positive Climate. Items and 
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loadings for both components are reported in Table 3. The exact factor 
scoring method was used to create two criterion variables. 
Predictor Variables: 3HIC Pro portions 

In the SHIC system, the observer's task is to record the continuous 
stream of group behavior by assigning a code to each conment that is made 
during the group interaction phases of the meeting (the "Middle Routine," 
which includes testing of knowledge of the GROW handbook and a reading and 
discussion, was not coded). 

Ele-en observers were trained in the SHIC system using videotapes of 
simulated GROW meetings. Reliability was assessed by comparing an 
observer's set of codes for a given tape with a standard or criterion set of 
codes. Our cooperation with the organization allowed us to video-tape 
several GROW meetings to use in assessing observer reliability. It was 
necessary to use videotapes for r- lability testing rather than live inter- 
observer agreement because we were calculating point by point agreement and 
had no way of synchronizing the two observers' streams of codes at a live 
meeting. Observers were considered reliable when they achieved a level of 
agreement equal to or greater than a Kappa of .70 on a reliability test. 
Cohen's (1960) Kappa statistic provides a more conservative estimate of 
reliability than an overall percentage agreement score secause it estimates 
controls for chance agreement. In order to check for reliability drift and 
decay, observers took reliability tests every three months. If they did not 
achieve a Kappa of .70, they were retrained until they tested with a Kappa 
of 70 or better. The actual range of Kappa coefficients on reliability 
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tests (excluding any tests taken after retraining) was .52 to .92 with a 
median coefficient of .72. 

In order to control for length of meeting and verbosity of 
participants, all SMC variables were converted to proportion variables, 
calculated as the frequency of each code divided by the total number of 
coded units at a given meeting. PreMminary analyses revealed nonnormal 
distributions for many of the SHIC proportion variables. In order to 
normalize the SHIC variable distributions, they were transformed using the 
T-scaling technique (see Guilford & Fruchter, 1978, pp. 478-484) prior to 
any subsequent analyses. 

Results 

Table 4 presents the zero-order correlations among the SHIC proportion 
variables and the three meeting evaluation variables. The observers' 
evaluation of Meeting Quality was not significantly correlated with the 
participants' evaluation of Meeting Quality (r = .09). The observers' 
evaluation of Positive Climate, however, was related to the participants' 
evaluation of Meeting Quality (r = .38, p<.00l). 

Three stepwise multiple regression analyses were performed with the 
participants' evaluation of Meeting Quality and the observers' evaluation of 
Meeting Quality and Positive Climate serving as criterion variables and the 
twelve SHIC behavioral variables serving as predictor variables. 

In the analysis focusing on the prediction of the participants' 
evaluation, four behaviors were significant predictors: negative, support, 
direct guidance, and interpretive comments. Table 5 lists the predictor 
variables in order of t.'ieir entry into the equation, the multiple 

11 



11 



correlation (R), increase in R 2 , and F ratio at each step, and standardized 
regression coefficient (8) and zero order correlation(r) for each variable. 
Va. Sables with nonsignificant (jj >.05) 4R 2 s are not reported in the 
table, but the final R after entry of all twleve variables is indicated. 
The four behaviors in combination acounted for 10% of the criterion 
variance. The presence of negative behaviors such as disagreement and 
disapproval during a meeting was negatively related to a positive evaluation 
of the meeting, accounting for 4% of the variance (F = 10.44, £<.001). 
Supportive comments accounted for an additional 3% of the variance (F = 
9.37, £<.01). Direct guidance contributed 2% (F = 5.56, £<.05) and 
interpretive comments contributed 1% (F = 3.90, £<.05). 

Both analyses focusing on the prediction of observer's evaluations of 
the meeting are summarized in Table 6. Again, only variables with 
significant 4R s are tabled. The observer's evaluation of meeting 
quality was predicted by three variables: group process, agree, and 
personal disclosure, which together accounted for 12% of the criterion 
variance. The rest of the behavioral variables together accounted for an 
additional 2% of the variance (final R = .38). Group process accounted for 
5% of the variance (F = 17.05, £ <.001) and was the first variable to enter 
the equation. This was followed by agree, accounting for an additional 4% 
of the variance (F = 12.65, £ <.001), and personal disclosure accounting for 
still another 2% 0 f the variance (F = 7.37, £ <. 0 l). Observers, then, were 
likely to evaluate the meeting positively when the proportion of group 
process or structuring, directive comments was low and the proportion of 
agreements, acknowledgements, and personal disclosures was hiqh 
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The third and final regression analysis concerned the prediction of the 
observers' evaluation of the Positive Climate of the meeting. Four 
behavioral variables were found to be significant predictors, accounting for 
19% of the criterion variance (R = .44). The lion's share of this variance 
was accounted for by the first variable to enter the equation, negative 
behaviors (R = .37, F = 46.76, p<.001). Personal questions, supports, and 
interpretive conments each contributed an additional 2% to the variance 
accounted for (F = 6.42, £<.05; F = 6.09, £< .05; F = 6.67, £<..05, 
respectively). 

Discussion 

Participants 1 positive evaluations of a self-help meeting were 
predicted by the relative absence of negative behaviors (ruch as 
disagreements, disapproval, and defensiveness) and the presence of 
help-giving behaviors (such as supportive and interpretive comments and 
direct guidance and suggestions). Observers' evaluations were divided into 
two components, meeting quality and positive climate. Meeting quality was 
predicted by the abser.ce of the structuring, orchestrating conments coded 
as "group process" and the preponderance of the agree and personal 
disclosure cedes. A positive meeting climate as evaluated by the observer 
was predicted by variables very similar to those important in the 
participant's evaluation of meeting quality. The relative absence of 
negative behavior was the single most important predictor. Meetings in 
which disagreements, disapproving statements, or defensiveness occurred in 
high proportions were not evaluated positively. In addition, the absence of 
probing, personal questions and the presence of interpretive and supportive 
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comments was likely to lead to a positive evaluation of the meeting's 
climate. 

These results represent a departure from what was expected with respect 
to the correspondence between the participant's and the observer's 
evaluations. Inspection of the items comprising each of the evaluation 
components leads to the expectation that the participants' evaluation of the 
meeting quality would be most closely related to the first component of the 
observer's evaluation, which was consequently also labelled "Meeting 
Quality." The correlation between these two factors, however, was minimal. 
Moreover, there was no overlap in the behavioral predictors of the 
participants' and observers' evaluations of meeting quality. Although 
bearing little or no "face" resemblance to the participants' evaluation of 
Meeting Quality, the observers' Positive Climate variable showed a strong 
relationship to the participants' evaluation. Participants were likely to 
feel that meetings were helpful and "good" when the same behaviors were 
present that Uu observers to rate a meeting as pleasant, warm, trusting, 
and relaxed. The importance of negative behaviors in predicting a low 
evaluation of the meeting by the participants and a negative climate for the 
observers was striking, especially in light of the low baserate of negative 
codes overall. 

It was group process comments, rather than negative benaviors, 
that adversely effected observer's evaluations of the quality of the 
meeting. Observers tended to feel that the quality of a meeting was 
compromised when there were too many structuring, directive comments. A 
high proportion of group process comments may be a function of a dominant, 
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controlling leader, or a reflection of a strong need for control and 
direction in the group because of an inactive, irexperienced, or low 
functioning constellation of group members. 

It is interesting to note that the observers focused on behaviors of 
the "helpee" (agreements and disclosures) in their evaluation of meeting 
quality while the participants focused on behaviors characteristic of the 
"helper" (supports, interpretations, and guidances). From the participants' 
perspective it is the type of response that members receive when they 
present a problem rather than how deep, heart-felt, or disclosive their 
problem presentations are. It seems that the participants are keyed into 
the "caring" and the observers into the "sharing" part of GROW's ideal of a 
"caring and sharing community." Overall, the behavioral variables of the 
SHIC system are moderately predictive of participants' and observers' 
evaluations, accounting for between 13 and 20% of the variance. The global 
nature of many of the evaluation items may explain the modest amount of 
variance accounted for. 

It is possible that there are behavioral events and processes that are 
extremely predictive of meeting evaluations which are not tapped by the 
twelve SHIC proportion variables. Simple proportion variables ignore the 
sequence and context of behaviors within a meeting. There is a growing 
realization among researchers of the importance of patterning and sequence 
in social interaction (see Cairns, 1979; Gottman, 1979; Lamb, Suomi & 
Stephenson, 1979). Consider, for example, two meetings in which suggestions 
or "guidances" are given in response to someone with a problem at the same 
rate, but in cne meeting the problem presenter responds with a 
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qualification, additional information, or acceptance- or rejection of the 
advice immediately following each interpretation while in the second 
meeting, the guidances fly in shot-gun style with no chance for the problem- 
presenter to respond or to assimilate the barrage of information. The 
sequences in which behaviors follow one another clearly differentiate these 
two meetings. Similarly, it may be that a high proportion of supportive 
comments is not as important as a high rate of the particular sequence in 
which supportive comments follow heart-felt personal disclosures. Future 
research directed at these difficult questions could deepen our 
understanding of the appeal and effectiveness of the self-help alternative. 
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TABLE 1: SHIC CODING CATEGORIES 

S= Support: comments which have the aim or effect of raising or enhancing 

another group member's status, are nurturing, encouraging or approving 
of another group member, or offer tangible assistance. 

I = Interpretive Comments: comments wnich interpret, analyze, evaluate, redefine, 
reconceptualize, challenge, summarize or explain another group 
member's comments or behavior. 

G= Direct Guidance: comments which give concrete, direct and specific 

suggestions, direction, or guidance about possible courses of action. 

R= Requests for feedback or help: comments which directly request the group or a 
particular member of the group to provide the speaker with an 
evaluation, interpretation, suggestion, information, or guidance about 
the speaker's feelings, actions, personal life or group behavior. 

Q = Personal Questions: comments which request revealing information about an 
individual's feelings, motivations, opinions, or actions. 

?= Impersonal Questions: comments which ask for orientation, clarification, 

•repetition, general factual information about the world or impersonal 
("safe", factual or superficial) information about another individual. 

D= Personal Disclosures: comments which give specific personal information about 
the speaker or someone in the personal life of the speaker. 
"Personal" information includes any discussion of feelings, desires, 
expectations or behaviors which are generally non-public and not 
ordinarily volunteered to others. 

F= General Sharing: comments which give clarification of previous cormients, or 
general, impersonal, trivial, vague or abstract information about the 
world, the speaker, or other individuals. 

P= Group Process: comments which have the aim or effect of altering or 
reflecting on the immediate group process. 

A= Agreement: comments which show agreement with an opinion or interpretation 
previously stated, show acceptance or acknowledgement of support or 
feedback, or verbally indicate that the speaker will comply with a 
suggestion or guidance. 

N= Negativ e: comments which explicitly disagree with a previously stated 
opinion or interpretation, areresistant, closed or defensive, or 
indicate disapproval of any part of the GROW method or philosophy, 
another group member or the speaker himself. This category is the 
negative counterpart of both the Agreement and Support categories. 

T= Irrelevant Talk: comments which are not relevant to the group's current 

ta^k or are nonsensical or inappropriate in the context of the GROW 
group. 
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Table 2: Participant's Evaluation of the Meeting: 
Items and Factor Loadings 



Description of Item Meeting Quality 



Overall assessment of the "goodness" of the meeting 
Group's enthusiasm about members' progress 
Group's helpfulness for members 
Interest level of the discussion of the reading 
Group's helpfulness for participant 
Group's demonstration of support for participant 

Participant's change in feelings 3 
Percentage of Total Variance 

Constructed by taking the difference score between two items on the PRF. N=334 



.67 
.51 
.63 
.60 
.70 
.68 

.68 
34.2 
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Table 3: Observer's Evalu tion of the Meeting: 
Items and Factor Loadings 3 



Meeting Positive 

Description of Item Quality Climate 

Overall assessment of the Goodness of the Meeting (.80) .35 

Goodness of the Group Interaction Phase (.75) .34 

Goodness of the Middle Phase (.62) [u 

Goodness of the Resumed Interaction Phase (.72) .25 

Focus on GROW teachings 43 _ 06 

J ™ st .38 (.*61) 

Pleasantness .11 (.79) 

Tenseness ^8 (-.*82) 

Interest level (.72) n 

Intensity (.73) _; 08 

Warmth .33 (.72) 

Percentage of Total Variance 40.*6 16.*5 

a Lcadings greater than .50 are ,n parentheses. N = 334 
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Table 4: ^^relations ,^ong SHIC Proportions and the Participant's 
and Observer's Evaluations of the Meeting l,c, P anc 




x.05, **p < .01 , ***p <.001 . H = 334. 



9 

ERIC 
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Table 5: Summary of Stepwise Regression: Significant 
Behavioral Predictors of Participants 
Evaluation of Meeting Quality 



Variable 



R 



Increase in 
R 2 



F for 
increase 



8 



Negative Behavior .19 

Support .26 

Direct Guidance .30 

Interpretive Comments .32 

Final R at 12 Step .36 



.04 
.03 
.02 
.01 



10.44*** 
9.37** 
5.56* 
3.90* 



-.19 -.19 

.17 .18 

.13 .09 

.12 .09 



*p<.05, **p<.01, ***p<.00l 



ERIC 
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Table 6: Summary of Stepwise Regression: Significant 
Behavioral Predictors of Observer's Evaluation of 
Meeting Quality and Positive Climate 

Increase in F for 
Variable R r 2 increase 



Criterion 1: Meeting Quality 



Group Process .23 

Agree .30 

Personal Disclosure .34 

Final R at 12th Step .38 



.05 
.04 
.02 



17.05*** 
12.65*** 
7.37** 



-.23 
.20 
.15 



-.23 
.21 
.16 



Criterion 2: Positive Climate 



Negative Behavior .37 

Personal Question .39 

Support .41 

Interpretive Comnents .44 

Final R at 12 Step .45 



.14 
.02 
.02 
.02 



46.76*** 


-.37 


-.37 


6.42* 


-.14 


-.17 


6.09* 


.13 


.12 


6.67* 


.14 ' 


.13 



*p<.05, **p<.01, ***pc.001 



9 

ERIC 
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